Independent Nonlinear Component Analysis
نویسندگان
چکیده
The idea of summarizing the information contained in a large number variables by small “factors” or “principal components” has been broadly adopted statistics. This article introduces generalization widely used principal component analysis (PCA) to nonlinear settings, thus providing new tool for dimension reduction and exploratory data representation. distinguishing features method include (i) ability always deliver truly independent (instead merely uncorrelated) factors; (ii) use optimal transport theory Brenier maps obtain robust efficient computational algorithm; (iii) multivariate additive entropy decomposition determine most informative components, (iv) formally nesting PCA as special case linear Gaussian factor models. We illustrate method’s effectiveness an application excess bond returns prediction from macro factors. Supplementary materials this are available online.
منابع مشابه
Nonlinear Independent Component Analysis By
Independent component analysis is often approached from an information theoretic perspective employing specific sample estimates for the mutual information between the separated outputs. These approximations involve the nonparametric estimation of signal entropies. The common approach involves the estimation of these quantities and adaptation based on these criteria. In contrast, in this paper,...
متن کاملRank based Least-squares Independent Component Analysis
In this paper, we propose a nonparametric rank-based alternative to the least-squares independent component analysis algorithm developed. The basic idea is to estimate the squared-loss mutual information, which used as the objective function of the algorithm, based on its copula density version. Therefore, no marginal densities have to be estimated. We provide empirical evaluation of th...
متن کاملKernel-Based Nonlinear Independent Component Analysis
We propose the kernel-based nonlinear independent component analysis (ICA) method, which consists of two separate steps. First, we map the data to a high-dimensional feature space and perform dimension reduction to extract the effective subspace, which was achieved by kernel principal component analysis (PCA) and can be considered as a pre-processing step. Second, we need to adjust a linear tra...
متن کاملNonlinear Approaches To Independent Component Analysis
Recently, there has been a great interest in statistical models for learning data representations. A popular method for this task is Independent Component Analysis (ICA) which has been successfully applied for the blind separation of mixed sounds and the analysis of biomedical signals. ICA relies on strong assumptions such as the linear mixing model, the requirement that the number of sensors a...
متن کاملMinimal Nonlinear Distortion Principle for Nonlinear Independent Component Analysis
It is well known that solutions to the nonlinear independent component analysis (ICA) problem are highly non-unique. In this paper we propose the “minimal nonlinear distortion” (MND) principle for tackling the ill-posedness of nonlinear ICA problems. MND prefers the nonlinear ICA solution with the estimated mixing procedure as close as possible to linear, among all possible solutions. It also h...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of the American Statistical Association
سال: 2021
ISSN: ['0162-1459', '1537-274X', '2326-6228', '1522-5445']
DOI: https://doi.org/10.1080/01621459.2021.1990768